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(57) ABSTRACT 

A bandwidth conserving queue manager for a FIFO buffer is 
provided, preferably on an ASIC chip and preferably includ- 
ing separate DRAM storage that maintains a FIFO queue 
which can extend beyond the data storage space of the FIFO 
buffer to provide additional data storage space as needed. 
FIFO buffers are used on the ASIC chip to store and retrieve 
multiple queue entries. As long as the total size of the queue 
does not exceed the storage available in the buffers, no 
additional data storage is needed. However, when some 
predetermined amount of the buffer storage space in the 
FIFO buffers is exceeded, data are written to and read from 
the additional data storage, and preferably in packets which 
are of optimum size for maintaining peak performance of the 
data storage device and which are written to the data storage 
device in such a way that they are queued in a first-in, 
first-out (FIFO) sequence of addresses. Preferably, the data 
are written to and are read from the DRAM in burst mode. 

12 Claims, 2 Drawing Sheets 
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QUEUE MANAGER FOR A BUFFER data input 12 from an outside source which is inputted to an 

input FIFO (first- in, first-out) buffer 14 in which the data is 
arranged in a queue. Data 16 is outputted from the input 

HELD OF THE INVENTION FIFO buffer 14 to a memory interface 18 and to a multi- 

5 plexor (Mux) 20. The memory interface 18 connects to a 

This invention relates generally to management of queues DRAM chip 22 which is a separate chip. (However, the 

of data being received from an outside source and inputted DRAM could be formed on the ASIC 10.) The multiplexor 

into a device for further processing. In more particular 20 is controlled by multiplexor control logic 24 to output 

aspects, this invention relates to an improved DRAM used data 16 from FIFO buffer 14 selectively to the DRAM chip 

in conjunction with a FIFO buffer for controlling the queue 1Q 22 or to an output FIFO buffer 32. The FIFO buffer 32 

of received data. outputs data 34 to the device (not shown) to which data is 

being supplied. 

BACKGROUND OF THE INVENTION ln gen eral, the queue manager shown in FIG. 1 operates 

There are many applications in which data is received at in the following manner: Data 12 to be written into the queue 

a higher rate than it can be utilized by a particular device for is * !?P uUed to P° buff !, r £ ata 16 ! eavmg th ' 

short periods of time, thus necessitating queuing data for FIF0 mav S° f lher <° ^ °utput FIFO 32 or to the external 

orderly input into the device on which it is to be used. A memo ? interface 18 and then to the DRAM chip 22 as 

common type of queue is fiist-in, first-out (FIFO) buffers controlled by the mux 20 and by mux control l 0g? c 24 

which temporarily store the data being received from some ? c P cn * n « ° n °J " ot there *i™l gh J°°™ c in ^ 

outside source for input into the receiving device at a rate the 20 input FIFO buffer 14 and the output FIFO buffer 32 for the 

receiving device can accommodate. One of the problems data beiD S read frora aD external source - ™* mux 20 15 

encountered is that the FIFO buffers may exceed their controlled based on this condition i.e whether the input 

capacity to store data inputted faster than it can be outputted. ™° buffe ' 14 and 0Ut P ut HFO bu ^ er 32 are ™ ° r 

Thus, there is a need for a technique for managing data in an have a predetermined I percentage of capacity filled. When 

orderly way with minimum overhead for periods of time 25 there is more data to be stored in the input FIFO buffer 14 

when such data being inputted is greater than the storage and 0Ut P ut FIF0 buffer 32 lhaD lhe maximum permitted, the 

capacity of the FIFO buffer or buffers. mux 20 xlects data t0 be wntten 10 the external memor y 

interface 18 and the data is then stored in the DRAM chip 

SUMMARY OF THE INVENTION 22 - As the output FIFO buffer 32 is read out, the data is read 

30 from the DRAM chip 22 through the memory interface, to 

According to the present invention, a bandwidth conserv- me output FIFO buffer 32 under the control of the mux 

ing queue manager for a FIFO buffer is provided, preferably control logic 24. Thus, as long as the amount of input data 

on an ASIC chip and preferably including a separate DRAM 12 being read from an external source does not exceed a 

that maintains a FIFO queue which can extend beyond the preselected capacity of the input FIFO buffer 14 and output 

data storage space of the FIFO buffer to provide additional 35 FIFO buffer 32, the data is passed from the input FIFO buffer 

data storage space as needed. FIFO buffers are used on the 14 directly to the output FIFO buffer 32. 

ASIC chip to store and retrieve multiple queue entries. As However, when the amount of data 12 being inputted 

long as the total size of the queue does not exceed the storage exceeds the capacity or predetermined percentage of capac- 

available in the buffers, no additional data storage is needed. ity 0 f the mput pjpo buffer 14 and the output FIFO buffer 

However, when the buffer storage space in the FIFO buffers 4Q 32> then the data is written by the input FIFO buffer 14 to the 

is exceeded, data are written to and read from the additional DRAM chip 22 through the memory interface 18. The 

data storage preferably a DRAM and preferably in packets DRAM chip 22 is structured to be written and read on a 

which are of optimum size for maintaining peak perfor- fi rs t-in, first-out basis at contiguous addresses so that 

mance of the data storage device and which are written to the address mapping is not required as in a conventional cache 

data storage device in such a way that they are queued in a 45 memory . data [ s wr j tten to the input FIFO buffer 14 from 

first-in, first-out (FIFO) sequence of addresses. The DRAM the externa i source and to the output FIFO buffer 32 from the 

can be a separate chip, or it can be formed on the ASIC. In input pip 0 buffer 14 one data item at a time. However, 

either case, its memory is separate from the FIFO buffer or preferably the data is written to the memory interface 18 and 

Duffers. thence to the DRAM chip 22, and read from the DRAM chip 

nccrDiirnnM tuc nDAWiwrc 50 22 bv 0Ut P Ut nF0 32 in burStS ° f muIti P le data items t0 

DESCRIPTION OF THE DRAWINGS miHze the optimum transfer rate of the DRAM chip 22. 

FIG. lis a high level diagrammatic view of the structure Moreover, because the DRAM is arranged so that it is 
of the managed DRAM queue manager of the present ordered on a first-in, first-out basis, the burst capabilities can 
invention* be use d and no address tags need be applied to the data 

inn -> \, « A~* n -i~A c „„u,. ~p *u» 55 written thereto. Thus, for example, the data can be written to 

FIG. 2 is a detailed view, somewhat diagrammatic, ot the . Jt ^V**** L - ^ • 1 * c *u 

in ut FIFO buffer- and r DRAM chip 22 in data packets of three 

inpu u e , items, rather than have to read each data item individually by 

FIG. 3 is a detailed view, somewhat diagrammatic, of the address . It ^ a is 0 preferred that the DRAM be a DDR 

output FIFO buffer. (double data rate) DRAM. Double data rate DRAM allows 

nP<;rRiPTTnM nv TI4F PRFFFRRFD 60 twice lhe data bandwidth for a number of I/O pins on 

DESCRIPTION OF TOE DEFERRED ^ AS]C packa g e ^ does standard synchronous DRAM 

This is accomplished by launching and capturing data on 
Referring now to the drawings and, for the present, to both the rising and falling edge of the clock signal. RAM- 
FIG. 1, an overview of the structure and operation of the BUS is another scheme of increasing the bandwidth per in 
bandwidth conserving DRAM queue manager according to 65 which may be beneficial in some applications, 
the present invention is shown. The queue manager is Referring now to FIG. 2, a more detailed depiction of the 
formed on an ASIC chip 10. The queue manager receives input FIFO buffer 14 is shown. The input FIFO buffer 14 
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includes latches at storage locations 40a, 40b, 40c, 40d, 40e input FIFO buffer 14 is full or empty and the data storage in 

and 40/ for six different data items. The data items are read output FIFO buffer 32 is full or empty and to control the 

one data item at a time from an external source and are operation of the mux 20 accordingly. The read and write and 

written in the FIFO buffer 14, one data item at a time, under comparator in the DRAM operate in the same way. (It 

control selectors 42a, 42b and 42c. A write pointer 44 and 5 should be noted that in some applications a linked list of data 

read pointer 46 are both provided which provide outputs to items can be rather thaD read and write pointers), 

a comparator 48. The output of the comparator 48 goes to the T° e bus width of the interfaces to the input data 12 and 

mux control logic 24. As indicated above, the data is written 0Ut P ut data 34 can be the same as the bus width at the 

in bursts, e.g. three data items from the FIFO buffer 14 to the memory bus interface. However, different bus widths may 

DRAM 20 or one data item at a time to the output FIFO 10 be desirable especially if a DDR DRAM is used. The 

buffer 32 responsive to the control of the mux 20. A detailed wm< * must be made based on the particular 

view of the output FIFO buffer 32 is shown in FIG. 3. application is the amount of on-chip buffering which wiU be 

r provided (silicon area) versus the efficiency of the data 

Shown in FIG. 3 are data item latches at storage locations transfer (bandwidth). In most cases, the bandwidth is more 

50a 50b, 50c ,5Qd, SOe and 50/and selectors 52a, 52b, 52c, i mp o rt ant. The maximum bandwidth is determined by the 

S2d,S2e and 52/ which control the inputs 54a, 54b, 54c, 54d, is of tfae DRAM interface m6 me 

rate at which it can 

54* and 54/ to .storage locations 50^-50/ Data outputs 56a, accept commands and data . These rates are a property of the 

566, 56c, S6d, 56e and 56/ from the data item storage DRAM and the width is selectable, although the number of 

50a-5G/ are provided which go to a selector 58 to provide l/0s on an ASIC is usually a limiting factor these 

the data output 34, the data being outputted one data item at issues are weighed> tnere wil i be a parlicu i ar minimum 

a time. A write pointer 62 and a read pointer 64 are provided 20 packe( ^ required tQ miaUda lhis max imum bandwidth, 

which output signals to a comparator 66. Comparator 66 input data 12 and output data 34 widths will usually be 

outputs its difference to the mux control logic 24. dictated by the particular app ii cat ion so the variable is on the 

Also, the DRAM 20 has a write pointer, a read pointer and on-chip buffer size which would be the minimum DRAM 

a comparator (all not shown), the output of which DRAM packet size divided by the data item size times four. (The 

comparator is also provided to the mux control logic 24 As 25 input and output FIFOs each need to be able to store two 

indicated above, the data is written to the output FIFO 32 memory packets worth of data.) 

from the DRAM in multiple data items to utilize the opti- x 0 summarize the operation of the device of this 

mum data rate transfer of the DRAM. The memory interface invention, data is read into the input FIFO buffer 14 from an 

is responsible for maintaining pointers to the head and tail outside source and is written from the input FIFO buffer 14 

portions of the queue which is stored in the DRAM chip 22, t0 tne output FIFO buffer 32 as long as the output FIFO 

By having contiguous addresses and head and tail pointers, buffer 32 is not full. When the output FIFO buffer 32 

the need for individual addresses is eliminated, and the becomes full and the input FIFO buffer 14 becomes half full, 

DRAM chip 22 acts in a FIFO mode. tne mux 20 shifts and allows the input FIFO buffer 14 to 

The multiplexor 20 is controlled by the multiplexor 35 write data to the DRAM chip 22 and allows the output FIFO 

control logic 24 in the following way: Initially, data 12 is buffer 32 to read data from the DRAM chip 22. The output 

inputted to the input FIFO queue in the FIFO buffer 14 one from the output FIFO buffer 32 is outputted as output 34. 

data item at a time, and, assuming the output FIFO buffer 32 When the output FIFO buffer 32 and the DRAM chip 22 are 

is empty, the data is passed from the input FIFO buffer 14 empty, the mux 20 then allows the input FIFO buffer 14 to 

direcLly to the output FIFO buffer 32 by the action of the 4Q write directly to the output FIFO buffer 32. Thus, the DRAM 

mux 20. When the output FIFO buffer 32 is completely full chip 22 acts as an additional buffer space when the data input 

and the input FIFO buffer 14 is half full, the mux 20 is 12 is greater than input FIFO buffer 14 and output FIFO 

switched by the control logic 24 responsive to the compara- buffer 32 can handle, 

tors 48 and 66 to pass data through the memory interface 18 What is claimed is: 

to the DRAM chip 22 on the write cycle in multiple data 45 1. A queue manager for managing data input to a system 

items and for the output FIFO 32 to read data from the from an outside source, comprising: 

DRAM chip 22 through the memory interface 18 on the read an input FIFO buffer for receiving and storing data items 

cycle in multiple data items. When the comparator in the from said outside source; 

DRAM indicates that there are no more data items stored in an output FIFO buffer for receiving, storing and output- 

the DRAM chip 22, the mux 20 is switched back to pass the 5Q t ing data items to said system; 

data from the input FIFO buffer 14 to the output FIFO buffer a mem ory storage device interfacing with said input FIFO 

buffer, and said output FIFO buffer, and a control 

The control of the memory interface, as indicated above, mechanism to selectively write data from said input 

is accomplished by a write pointer to keep track of where the FIFO buffer to said memory storage device, and read 

next group of data items will be written and a read pointer 55 data from said memory storage device to said output 

to keep track of from where the next group of data items will FIFO buffer; 

be read. The comparator determines if these two pointers are wherein said control mechanism includes logic to connect 

the same, which indicates the buffer is either full or empty. sa j d mput piFO buffer to said output FIFO buffer until 

The read and write pointers work in the following way: sa id output FIFO buffer is filled to a first predetermined 

When the read and write pointers are at the same data 60 amount and said input FIFO buffer is filled to a second 

location on a read cycle, it means the storage locations are predetermined amount, and thereafter connect said 

empty, and when the read and write pointers are at the same mput FIFO buffer to said memory storage device until 

location on a write cycle, it means that the storage locations sa i d memory storage device is empty and said output 

are kU- FIFO buffer is empty, and then connect said input FIFO 

Thus, the read and write pointers and comparators 44, 46 65 buffer to said output FIFO buffer, 

and 48 and read and write pointers and comparators 62, 64 2. The invention as defined in claim 1 wherein said data 

and 66, operate to indicate whether the data storage in the is stored in said input FIFO buffer and said output FIFO 
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buffer as data items, and said control circuit includes circuit 
logic to write data to said output data buffer and read data 
from said input FIFO buffer in multiple packets of data 
items. 

3. The invention as defined in claim 2 wherein said 
memory storage device is configured to read and write data 
in burst mode, 

4. The invention as defined in claim 1 wherein said 
memory storage device includes at least one DRAM chip. 

5. The invention as defined in claim 1 wherein first 
predetermined amount is completely fill and second prede- 
termined amount is one-half frill. 

6. The inventions defined in claim 1 wherein said control 
mechanism includes a multiplexor. 

7. The invention as defined in claim 4 wherein said 
DRAM chip is a double density DRAM chip. 

8. A method for managing data input to a system from an 
outside source, comprising the steps of: 

providing an input FIFO buffer for receiving and storing 

data items from said outside source; 
providing an output FIFO buffer for receiving, storing and 

outputting data items to said system; 
providing a memory storage device interfacing with said 

input FIFO buffer, and said output FIFO buffer; 
providing input data to said input FIFO buffer and output 

data from said output FIFO buffer, and 



10 



15 



20 



25 



controlling the data flow so as to connect said input FIFO 
buffer to said output FIFO buffer until said output FIFO 
buffer is filled to a first predetermined amount and said 
input FIFO buffer is filled to a second predetermined 
amount, and thereafter connecting said input FIFO 
buffer to said memory storage device and said output 
FIFO buffer to said memory storage device until said 
memory storage device is empty and said output FIFO 
buffer is empty, and then connecting said input FIFO 
buffer to said output FIFO buffer. 

9. The invention as defined in claim 8 wherein said data 
is written to said input FIFO buffer and said output FIFO 
buffer as data items, and data is written to said output data 
buffer and read data from said input FIFO buffer in multiple 
packets of data items. 

10. The invention as defined in claim 8 wherein data is 
written to and read from said memory storage device in burst 
mode. 

11. The invention as defined in claim 8 wherein said 
memory storage device includes at least one DRAM chip. 

12. The invention as defined in claim 8 wherein said first 
predetermined amount is completely full and said second 
predetermined amount is one-half full. 
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